Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Genesis export stream #519

Merged
merged 32 commits into from
Jul 29, 2024
Merged

Genesis export stream #519

merged 32 commits into from
Jul 29, 2024

Conversation

jewei1997
Copy link
Contributor

@jewei1997 jewei1997 commented Jun 21, 2024

Describe your changes and provide context

Writes genesis export to a file but with each module being appended to the file individually. We need this because we are running in an issue where the app state is too large to hold in memory causing an OOM. We currently assume that each individual module's app state is small enough to hold in memory.

Testing performed to validate your change

manual testing locally.

Copy link

codecov bot commented Jun 21, 2024

Codecov Report

Attention: Patch coverage is 9.25926% with 441 lines in your changes missing coverage. Please review.

Project coverage is 54.86%. Comparing base (8653b19) to head (db06037).

Additional details and impacted files

Impacted file tree graph

@@            Coverage Diff             @@
##             main     #519      +/-   ##
==========================================
- Coverage   55.27%   54.86%   -0.42%     
==========================================
  Files         631      631              
  Lines       54318    54771     +453     
==========================================
+ Hits        30026    30048      +22     
- Misses      22149    22572     +423     
- Partials     2143     2151       +8     
Files Coverage Δ
server/config/toml.go 17.85% <ø> (ø)
simapp/app.go 66.09% <100.00%> (ø)
x/bank/types/metadata.go 100.00% <ø> (ø)
x/distribution/keeper/store.go 50.00% <ø> (ø)
simapp/simd/cmd/root.go 69.38% <0.00%> (ø)
server/config/config.go 34.78% <50.00%> (+0.69%) ⬆️
x/auth/module.go 44.30% <0.00%> (-9.55%) ⬇️
x/auth/vesting/module.go 46.93% <0.00%> (-18.78%) ⬇️
x/bank/module.go 48.19% <0.00%> (-9.78%) ⬇️
x/capability/module.go 48.57% <0.00%> (-12.15%) ⬇️
... and 15 more

@jewei1997 jewei1997 changed the title Genesis export to file Genesis export stream Jul 22, 2024
server/config/config.go Outdated Show resolved Hide resolved
server/export.go Outdated Show resolved Hide resolved
server/start.go Outdated Show resolved Hide resolved
@jewei1997 jewei1997 enabled auto-merge (squash) July 29, 2024 17:17
@jewei1997 jewei1997 merged commit 2d2472d into main Jul 29, 2024
13 checks passed
@jewei1997 jewei1997 deleted the genesis-export-oom branch July 29, 2024 19:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants